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Any matrix B such that ABA = A is called a Ci-inverse of A and a d-inverse of A such that BAB = B 
is called a C 2 -inverse of A. Some properties of such inverses are established. It is shown that if A is 
p-square of rank q < p and P is any positive semidefinite matrix, whose rank is the nullity of A, such 
that U = A-\-P is nonsingular, then B=U~ X AU~ X is a C 2 -inverse of A with the property that null space 
B — null space B*. That such a P exists for arbitrary squared is shown. The relation between this result 
and the work of Goldman and Zelen is discussed. 
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1. Introduction 

Goldman and Zelen [1] J have shown how to con- 
struct a generalized inverse (of a kind made precise 
in what follows) of a real symmetric matrix A by in- 
version of a nonsingular matrix formed from A. It is 
inherent in the assumption that A is symmetric that 
the resulting generalized inverse is also symmetric. 

We show that if a complex matrix A and its conjugate 
transpose have the same null space (i.e., A is an EPr 
matrix [3]) then there always exists a generalized in- 
verse of the kind discussed which is also an EPr 
matrix. It is then shown that the construction given by 
Goldman and Zelen [1] goes through, essentially step 
for step, when the condition that A be real symmetric 
is replaced by the condition that A be an EPr matrix, 
and that the resulting generalized inverse is an EPr 
matrix. 

It is further shown that with no restrictions on A 
the Goldman-Zelen procedure produces a general- 
ized inverse which is EPr, although in this case the 
details of the construction are somewhat different. 
The (rather surprising) implication is that an arbi- 
trary square complex matrix always possesses a gen- 
eralized inverse, of the type discussed, which is an 
EPr matrix. In any given case a generalized inverse 
of this character can be obtained in principle by the 
Zelen-Goldman procedure, i.e., by inverting a certain 
nonsingular matrix and selecting from it a specified 
submatrix. 

2. Some Properties of Generalized Inverses 

All matrices considered have complex entries. 
We use the symbols p(V), N(V), R(V), and F* to de- 
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note the rank, null space, range and conjugate trans- 
pose of the matrix V. When V is square, \V\ denotes 
the determinant of V. For two subspaces Si and 
S>>, S\ • S>> is the intersection of Si and S2; Si ^ S2 
denotes that Si is a subspace of S 2 ; the dimension of 
Si is written dim Si. The symbol / denotes an iden- 
tity matrix of whatever order is appropriate in the 
context. 

For a given arbitrary matrix A we define by C\{A) the 
set of all matrices B such that ABA— A. We call any 
matrix in C X {A) a Converse of A. We define by C 2 (A) 
the set of all matrices B such that BeC x {A) and BAB=B. 
Thus BeC>(A) if and only if BeCM) and Aed(B); and 
BeC>(A) if and only if AeC>(B). We call any matrix in 
C 2 (A) a CVinverse of A. Ci-inverses and Converses 
have been termed by Rohde [4] generalized inverses 
and reflexive generalized inverses respectively. We be- 
gin with several lemmas regarding these kinds of 
generalized inverses. 

The first lemma, which we state for ready refer- 
ence, is due to Rohde [4J. 

Lemma 1. If A is any matrix and B is a Ci-inverse 
of A then p(B) ^ p(A) = p(AB) = p(BA). 

The next lemma was first proved by Rohde [4]. We 
here give a shortened proof of a quite different char- 
acter. 

Lemma 2. Let A be any matrix and B any Ci-inverse 
of A. Then B is a Cz-inverse of A if and only if p(B) 
= P(A). 

PROOF. Assume BeC>(A ) then since BeC { {A) we have, 
by Lemma 1, p(B)^p(A); and since also AeCi{B) we 
have, by Lemma 1, p(B)^p(A). Thus p(A) = p{B). 
Conversely, assume BeCi(A) and p(B) = p(A)=r. From 
ABA = A the matrix AB is idempotent and by Lemma 1, 
p(AB) = r. There are then linearly independent vectors 
%u 1 ^ i '>^ r, such that ABx x = x/. If there are n columns 
in B and y u 1 ^ i ^ n — r, are any basis of N(B) = N(AB) 
then AB yi =0. We then have BABx t = Bxi and BABy t 
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= Byi, from which it follows 2 that BAB = B and that 
BeC 2 (A). 

Lemma 3. Let P be an n X m matrix, Q and R be 
m X n matrices. If PQ is idempotent, p(PQ) = p(Q) and 
N(R)= N(Q), rAe/i RPQ = R. 

PROOF. If PQ is idempotent and p(PQ) = p{Q) = r, 
then as in the proof of Lemma 1, we have xu 1 ^ i ^ r, 
and y,-, l^i^n — r, linearly independent and such 
that PQ Xi = x u PQn = and yi€/V((>). If N(R) = N(Q) 
then RPQxi = Rxj and RPQyi = Ryi from which the 
conclusion follows. 

It has been seen that if BeCi(A) then i5^ is idem- 
potent and has the rank of A. The following corollary 
of Lemma 3 shows the converse of this to be true. 

Corollary 1. The matrix B is a Ci-inverse of A if 
and only if BA is idempotent and p(BA) = p(A); and 
if and only if AB is idempotent and p(AB) = p(A). 

PROOF. If Bed(^) then from ABA=A, AB, and &4 
are idempotent and that they have the rank of A is 
given by Lemma 1. Conversely, assume BA idempo- 
tent, p(BA) = p(A), and in Lemma 3 take P = B, R 
= Q = A. Then ABA = A and Bed(A). If AB is idempo- 
tent and p(AB) = p(A) then p(B*A*) = p(A*) and B*A* 
is idempotent. By Lemma 3 (with P = B*, R = Q = A*) 
we have A*B*A* = A* =$ ABA = A =$ BeCi(A). 

The following corollary of Lemma 3 gives a rela- 
tion between an EPr matrix and a Ci-inverse of that 
matrix. 

Corollary 2. A*=A*BA if and only if B is a 
Cx-inverse of A and N(A) = N(A*). Further, A* = ABA* 
t/arcd only if A* = A*BA. 

PROOF. If Bed (A) then BA is idempotent and has 
the rank of A. If further N(A ) = N(A*) , then Lemma 3 
(with P = B, Q = A, R = A*) gives A*BA=A*. Con- 
versely, if A*BA = A* then N(/4) ^A^(^*), and hence 
N(A)=N(A% and this being so A*BA = A* 
=$A*(I-BA) =0=$A(I-BA) = 0=) BtCi(A). That 
BeCi(A) and ZV(/4) = A^*) are necessary and suffi- 
cient for A* = ABA* is proved in the same way. 

REMARK: Corollary 2 can in fact be proved without 
recourse to Lemma 3. The "if part" follows at once 
from the fact [3] that N(A*) =N(A*)i£ and only if 
R{A)=R{A*). 

The next lemma shows that C 2 -inverses can be con- 
structed from C\ -inverses. 

Lemma 4. Let Bi and B 2 be any two {not necessarily 
distinct) Ci-inverses of A. Then B = BiAB 2 is a C 2 - 
inverse of A. 

PROOF. Given that B x and B 2 are in C\{A) we have 
ABA=(AB 1 A)B 2 A=AB 2 A=A, or that BeC^A). By 
Lemma 1, p(B)^p(A), but p(B) ^ p(B l A)= p(A) 
also follows from Lemma 1 and BieCi(A). Thus we 
have BeCi(A) and p(B)= p(A) , and Lemma 2 gives 
the conclusion BeC 2 {A ) . 

A C-inverse, i=l, 2, of a hermitian matrix is not 
necessarily hermitian but that a hermitian matrix 
always possesses at least one hermitian Ci-inverse is 

2 We observe that the v,. I < i ^ r, and _>,. 1 ^ i ^ n — r are a complete set of engenvectors 
of the projection E = AB and are thus linearly independent. For proof, let z = ZctiXi -f 2/3j>j. 
Then Ez= %a&t. If z = 0, then a, = 0, and given this, z = X/3j>; = 0, and /3j = 0. 



known 3 [4]. We observe that the existence of a 
hermitian Ci-inverse of a hermitian matrix insures, 
by Lemma 4, the existence of hermitian Converse. 
For if B^B^eCM) then B = B 1 AB 1 eC 2 (A) and is 
hermitian whenever A is hermitian. There is in fact a 
considerable list of properties such that by using 
Lemma 4 we can assert: If there exists a Ci-inverse 
with one of the properties then there exists a C 2 - 
inverse with that property. 

The next lemma shows that every EPr matrix pos- 
sesses a C 2 -inverse which is an EPr matrix. 

Lemma 5. Let A be a matrix with the property 
N(A) = N(A*). Then there exist matrices B such that 
BeC 2 (A) and N(B) = N(B*). In fact B = B^Bj*, where 
Bi is any ^-inverse of A, is such a matrix. 

Proof. If N(A)=N(A*) and B.eC^A) then by 
Corollary 2, we have A*B t A=A* and A*B,*A = A. Let 
B = B 1 A*B 1 *, then ABA=AB 1 (A*B l *A)=AB 1 A=A. 
Thus BediA). By Lemma 1, p(B)^p(A). On the 
other hand p(B) =ss p(A^B^) = p{A) follows from 
Lemma 1 and the construction of B. Hence by Lemma 

2, BeC 2 (A). Clearly N(B,*)^N(B) and N(Bi*) 
^N(B*). But p(B 1 )=p(B), for we have just proved 
p(A) = p(B) and p{A) = p(B\) follows from Lemma 2. 
Hence N(B)=N(B*). 

3. Ci-inverses by Inversion of a Nonsingular 

Matrix 

Let A be a p X p matrix, p(A)= q, K be a p X r matrix 
and define the matrices M and U as follows: 



M 



A 
K* 



U = A + KK*. 



(1) 



(2) 



We further denote by S and S* the subspaces S = N(A) 
-N(K*) and S* = N(A*) • N(K*). We then prove the 
following theorem. 

Theorem 1. Let M and U 6e as in (1) and (2). If 
r = p — q then any one of the following statements 
implies the other two: (i) S = and S* = 0, (ii) M _1 
exists, (iii) U _1 exists. 

PROOF, (i) & (ii). It has been shown [2] that S* = 
is equivalent to the existence of a matrix H such that 
H*A = and \H*K\ # 0. Assume (i) and let z T = (x T , y T ) 
be a suitably partitioned vector such that zeN(M). 
Then Ax + Ky=0 and K*x = 0. The first of these two 
equalities shows H*Ky=0=^y= 0. Given y=0 we are 
left with Ax = and /<** = so that jceS and hence 
* = 0. Thus (i)4(h)- It has been shown [2] that S^O 
=) |M| = and this same argument shows that S* t^ 
=)|M*| = 0. We then have S = 0^= |M| ^ 0^|M*| 
^0=4S* = 0. Hence (iiH(i). 

(i)f)(iii). Assume (i). Let xeN(U), then Ax + KK*x 
= 0. There is an // such that H*Ax+H*KK*x=H*KK*x 
= 0^K*x = 0. But then xeS and * = 0. Thus (iH(iii). 



3 The argument in [4J, and in Lemma 5 to follow, assumes the existence of a Ci-inverse. 
The existence of a Ci-inverse for an arbitrary matrix A was given constructive proof by 
Bose in 1959 and is given in [5] in detail. 
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Now assume (i) false. If (i) is false due toS ^ then |f/| 
= 0, since any xeS is in N(U); if (i) is false due to 5* # 
then |£/*|=0, since any xeS* is in N(U*). Thus (iii) 
=4(i). 

Whenever M _I exists 4 we partition this matrix in 
the same manner as M and write 



M-l: 



B 

Bn 



Bv2 

B, 



(3) 



Regarding the relation of the blocks in M to those in 
M~ l we have the following theorem. 

Theorem 2. Let M be as in (1). Assume M _1 to exist 
and be as in (3). Then, (i) AeC,(B), (ii) N(B) = N(B*), 
(iii) B is a Cz-inverse of A if and only if r=p — q, 
(iv) B 21 eC 2 (K), (v) B 12 eC 2 (K*), (vi) */ r =p-q, B 2 = 0, 
(vii) if r = p-q and N(A) = N(A*) then B* = B 21 . 

PROOF. It is known [2] that if M~ x exists then p(K) 
= r and r^p — q. Assuming M~ l exists we obtain 
from MM 1 = I and M~ X M = I 



AB + KB 2X = I 
K*B=Q 
BA + B X2 K* = I 
ABi2 + KB 2 = 0. 



(4) 
(5) 
(6) 

(7) 



From (4) and (5) we have at once B*AB = B* and (i) 
and (ii) follow from Corollary 2. Given (ii), (5) implies 
BK = and this with (4) gives KB 1X K = K. Thus 
Bn€Ci{K) and, by Lemma 1, p(KB 2X ) = p(K) = r. 
Since KB 2X is idempotent of rank r we now have from 
(4) that AB = I — KB 2 i is idempotent of rank p — r. 
But p{AB)= p(B) =p — r follows from (i) and Lemma 
1. Thus by Lemma 2, AeC 2 {B) and hence BeC>(A) if 
and only if p(A) =q = p(B) = p — r, and (iii) is proved. 
We have just seen that B 2X eC x (K) . Hence, by Lemma 1, 
p{B 2X ) ^ p(K) = r, but B 2 \ has r rows and thus p{B 2X ) 
= r and (iv) follows from Lemma 2. From (5) and (6), 
K*£ 12 £* = £* and BvzeC x (K*) implying, by Lemma 1, 
p(Brt) ^ p(K)=r. But B V2 has r columns, thus 
p(B X2 ) = r and (v) follows from Lemma 2. U r = p — q, 
then by Theorem 1, S* = and [2] there exists an H 
such that H*A = 0, \H*K\*0. This being so, (7) gives 
H*KB 2 = and (vi) is proved. If r = p — q then from 
(4), //*&£>, = //* gives B 2X =(H*K) X H*. If further, 
N(A)=N{A*) then from (6), B X2 K*H=H gives 
B a = H(K*H)~ 1 and (vii) is evident. 

The next theorem gives an explicit formula for the 
matrix B of Theorem 2 in terms of the matrix U in (2). 

Theorem 3. Let U be as in (2) and r = p — q. IfV~ l 
exists then B = U _1 AU _1 is a C 2 -inverse of A with the 
property N(B) = N(B*). If further N(A)=N(A*) then 
UBU*=l7*BU = A*. 



4 Although not needed in Theorem 1, it is a fact that the existence of M ' implies both 
p(K) = r and r > p — q [2]. cf. alternative proof of Theorem 3. 



PROOF. If U~ l exists and r= p — q then, by Theorem 
1, M~ l exists. This being the case, according to The- 
orem 2, the block B in (3) is a (? 2 -inverse of A with the 
property N(B) = N(B*). Further B obeys K*B = and 
BK = 0. From these last two equalities and the defini- 
tion (3) of U we have BU=BA and UB = AB which 
imply UBU = ABA=A and hence B = U 1 AUK We 
also have from UB = AB and BU* = BA* that UBU* 
= ABA*; and if N(A) = N(A*) then UBU* = A* follows 
from Corollary 2. Similarly from BU = BA and U*B 
= A*B we have U*BU = A*BA and if N(A) = N(A*) then 
U*BU=A*. 

It is of some interest to prove Theorem 3 without 
recourse to the existence of M~ l . 

Alternate Proof. If JJ- 1 exists and r=p — q then 
p(K) = r. For if p(K) < r, then dim N(K*)=p-p(K) 
>p-r and dim N(A) + dlm N(K*)> p-q + p-r 
= p=)S 7^0 and hence, by Theorem 1, \U\=0. Now 
U x A = l-U-iKK* shows that if xeN(A) then U^KK*x 
= *, and clearly yeN(K*) implies U^K^y^O. Thus 
given dim N(A) = p — q = r and dim N{K*) = p — r=q, 
we have that U~ l KK* is idempotent of rank r and so 
U X A is idempotent of rank q. By Corollary 1, U- l eC\(A) 
and U-teCtiKK*). By Lemma 4, B=U^AU-' is a Cz- 
inverse of A. From B = (U- 1 A)U- 1 = (I-U- 1 KK*)U- 1 
and U-'eCdKK*) it follows that KK*B = BKK* = 
and hence (since p(A) = p(K*/Q = r) that £*K = BK = 0. 
But dim N(B) = p-q=r = p(K) and hence A^Z?) 
= N(B*). The remainder of the proof is as given above. 

We observe from Theorem 2 that when p — q = r, 
every block in M~ x is a C 2 -inverse of an appropriate 
block in M (we agree that trivially a zero square matrix 
is its own C 2 -inverse), and that if additionally N(A) 
= N{A*) then M and M~ x are of the same form in that 
B2\ — Bx2. Furthermore we have from Theorem 3 that 
U- 1 AU- 1 = BeC2(A), U l eC,(A), as noted in the alter- 
native proof, and UeC\{B), which follows from BU 
=BA. This last set of relations among generalized 
inverses is a special instance of the following lemma. 

Lemma 6. Let B\ be any Ci-inverse of A, then 
B = BiABi is a C2-inverse of A and any Ci-inverse of 
Bi is a Ci-inverse ofB. 

PROOF. If B x eC x (A) then B x AB x =BeC>{A) is given 
by Lemma 4. Let QeC x {B x ) then BQB = B X AB X QB X AB X 
= B X AB X AB X = B X AB X = B and hence QeC x {B). 

In Theorems 2 and 3 it has been shown for r — p — q 
that the existence of a K such that M x and U~ l exist 
implies the existence of a B such that B is an EPq 
matrix and BeC 2 {A). If it is shown that such a K exists 
when A is an arbitrary p-square matrix of rank q, then 
we will have the conclusion that every square matrix 
possesses a C 2 -inverse which is an EP matrix. The 
next theorem shows this to be the case. 

Let X be the first block row of M, X= {A, K) and 
Y the first block column of M, Y*= (A*, K) . It is clear 
that p(X)=p if and only if S* = 0, for N(X*)=S*. 
Similarly p(Y) =p if and only if S = 0, since N(Y)=S. 
By Theorem 1, p(X) = p(Y) = p is necessary and suf- 
ficient for M~ l to exist and necessary and sufficient 
for U~ l to exist. This established, we need only to 
have the following theorem, called to the author's 
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attention by John W. Evans (Mathematical Research 
Branch, NIAMD, NIH) who kindly furnished the proof 
which follows: 

Theorem 4. Let A he a ^-square matrix, p(A) 
— q < p, p — q = r. Then there exists a pXr matrix 
K such that X = (A, K) and Y = (A*, K) have rank p. 

PROOF: We first show that given any two proper 
subspaces T and L, it is possible to select a vector 
x such that x $T and x$L. In the group theoretic con- 
text this result is well known, viz, the union of two 
proper subgroups of a given group cannot be that 
group. Let if be the set of all vectors x such that either 
xeT or xeL. There are two cases to be considered. 
First, either f < L or L < T and then there are cer- 
tainly vectors not in §f. Second T • L < T and T ■ L<L. 
In this case let J£t be the set of all vectors x such 
that x$T and x$T • L and let J£l be the set of all 
vectors x such that xeL and x$T • L. Now let xeJ^r and 
yeJ^L. Then z = x + y is not in if, since for example if 
zeT then z — x = yeT which contradicts yeJ^L. 



Let a\ 
Ofcj • . • 
a-2, . . ., 



a w be the columns of A and a% 



a-z, 

ot v the columns of A*. Define 7o={ai, 

a p } to be the subspace spanned by the at, 

p, and when appropriate vectors ki 9 fe, 



/cj have been selected define 7)={ai, a2, . . ., Op, &i, 
A; 2 , . . ., fej}, 1 ^7 '^ r, to be subspaces spanned by the 
vectors ai, . . ., %, k u k 2 , . . ., /cj. Similarly define 
Lo = {Q!i, «2, . . ., ol p } and L,= {ai, a 2 , . . ., ot p , k x , 
k 2 , . . ., kj] , l^y^r. Select a vector /ci such that 
ki$To and k\$L () \ select k 2 such that fefT^i and kziLu 



continue this process up to the selection of k r such that 
k r iTr-i and k r iL r -\. Now this selection process is 
always possible, for clearly dim r o = dim L = q and 
at each stage of the process dim Tj = dim Lj = q-\-j 
<p for O^y^r— 1. Assuming the above selection 
process completed, then dim TV = dim L r = p and 
p(X) = p(Y)=p as asserted. 

The following observation is due to A. J. Goldman 
(National Bureau of Standards): Since the proof of 
Theorem 4 nowhere makes use of the assumption that 
the ai are the columns of A*, we have in fact proved 
that if A and C are p-square matrices of rank q < p 
and r = p — q, then there exists a p X r matrix K such 
that [A, K] and [C, A:] have rank p. 
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